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Abstract. Let V be a 67L„(R)-distinguished, irreducible, admissible representa- 
tion of GL n (C). We prove that any continuous linear functional on V, which is 
invariant under the action of the real mirabolic subgroup, is automatically GL n (M)- 
invariant. 
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1. Introduction 

Let G = GL(n, C), H = GL(n, M.) and P < H be the standard mirabolic subgroup, 
i.e., the group consisting of matrices with last row equals to (0, 0, ...0, 1). We identify 
H\G with the space of matrices 

X = < x E G\x ■ x = I n 



via the isomorphism Hg h-> g^ 1 ■ g (for the proof of the surjectivity of the map see 
Lemma 12. ip . The group G acts on X by the twisted conjugation, xp(g) := g~ 1 xg. 
For a topological vector space V, we denote by V* the topological dual of V, i.e., the 
space of all continuous maps from V to C. Let 

V(X) = C?{X)* 

be the space of distributions on X. The space T>(X) is a topological space with the 
standard topology (T n -> T if T n (f) ->■ T{f) for every / e Cf{X).) 
In this paper we work with the category of the admissible smooth Frechet represen- 
tations of moderate growth, see [Walt Section 11.5], see also |AGSl Section 2.1]. 
Let (tt, V) be a representation of G. The representation (n, V) is called ^-distinguished 
if there exists a non-zero continuous linear map L : V — > C, such that 

L(n(h)v) = L(v) \/veV,heH. 
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We denote the space of all such linear maps by (V*) . 

Let V, W be two representations in our category. Then we denote by y^VF the 
completed tensor product with the projective topology (this is the 7r-topology in jT| 
Definitions 43.2 and 43.5]). 
We prove the following theorem 

Theorem 1.1. Let (tt, V) be an irreducible, admissible H- distinguished representation 
of G. Then 

(v*) p = (v*) H . 

The proof is based on section 3 of the article of Offen [D], see also |Okj . It is 
splitted into two steps as follows. 

Step 1: Reduction of the problem to a question on a single symmetric space X, defined 
above. More specificially, we prove that it is enough to show that V(X) P = V(X) H . 
Step 2: We prove 

Proposition 1.2. V(X) P = V(X) H . 

Let £ G T>(X) P . Note that the transpose acts on X. Indeed, let x G X. Then 
xx = I n . Let us take the transpose and bar on both sides of the last equality. Then 
we obtain = I n . Since the image of P under the map g h- >■* g^ 1 is t P and 

since t (xp(g)) =* xp^g -1 ), we obtain that £ G V(X) p . 

In order to prove Proposition 11.21 we use an idea that was suggested by Gourevitch 
(in personal communication). Actually, we prove a more general result, namely the 
following 

Proposition 1.3. Let £ G T)(X) GLn - 1< ^> . Then = £ ; i.e., £ is invariant under the 
transposition. 

Note that Proposition 11.31 implies Proposition 11.21 Indeed, let £ G V(X) P . Since 
GL n _i(R) < P we have £ G P(X) GL "- 1 W. Thus, by Proposition OJ the distribution 
£ is invariant under the transposition, and hence £ G D(X) p . But is generated by 
groups P and t P. Hence £ G V(X) H . 

This result is important since it allows us to prove that the following two linear forms 
on the Whittaker model of an irreducible, generic, and unitarizable distinguished 
representation (tt, V) defined by 

[ W{p)dp, 

and 

f W( ( ° l)p)dp 

JU n (M.)\P n (M.) \ \ U / / 

are GL n (lR)-invariant. Here, U n (M.) is the group of all upper triangular unipotent 
matrices of size n x n. 

The last result, combined with certain multiplicity one theorems, allows us to recover 
properties of epsilon factors of distinguished representations. 



DISTINGUISHED REPRESENTATIONS OF GL(n, C) 3 

Acknowledgements. I would like to thank Prof. Omer Offen for posing me this 
question and providing many explanations of the subject. 

I'm grateful to Prof. Dmitry Gourevitch for many fruitful discussions and his help. 
I also wish to thank Prof. Moshe Baruch, Dror Speiser and Tal Horesh for useful 
remarks. 

2. Notation and preliminaries 

We begin with the following simple lemma, which states the surjectivity of the map 
Hg H> g- 1 ■ g. 

Lemma 2.1. Let g G G be a matrix such that g ■ g = I n , where I n is the identity 
matrix of size n x n. Then there exists a matrix h G G such that g = h~ x ■ h. 

Proof. Let A G C be a scalar, define h — XI + Xg. One easily checks that 

h-g = Xg + X- I = h. 

Hence, if h is invertible we get g = hr l ■ h. Since A is arbitrary, we can choose it in a 
way, so that — t is not an eigenvalue of g. This finishes the proof. □ 

Consider an action of the 2-element group Z 2 on H given by: li 4 'ft -1 . It induces 
the semidirect product 

H := H x Z 2 . 
Define a character x on if by x(g,n) := (—1)™. 

We view the group GL n _i(M.) as a subgroup of H - i.e. matrices of the form 

An-l)x(n-l) 

1 

Similarly, define GL„_i(R) := GL n _i{R) x Z 2 . Clearly, this is a subgroup of H. 

In the first stage of the proof we will use the following result ( |AGSl Theorem A. 0.3] 

) 

Theorem 2.2. (Frobenius descent) Let G be a Lie group, assume G acts on two 
smooth manifolds X and Y , where the action on Y is transitive. Denote the actions 
by p\ and p2 respectively. Let p : X -» Y be a smooth surjective map that commutes 
with the action of G, i.e., for all g G G the following diagram commutes: 

X ^ X 
p 

Y y 

For every y &Y, let G y := Stab G (y), the stabilizer of y in G. Then 

V(Xf = V(p-\y)fy. 

Let (ir, V) be a continuous representation of the Lie group G on a Frechet space 
V. Define the space of differentiable vectors in V to be the set of all v G V such 
that the derivative 

— 7r(exp(tx))v\ t=0 
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exists for all x G Lie(G), where Lie(G) is the Lie algebra of G. The resulting vector 

is denoted by tt(x)v. 

We now define inductively for tiGN 

y (n) = {vE V^^ip^v E V [n - 1] for all x E Lie(G))}. 

Define 

oo 

v°° = pi v (n \ 

n=l 

Let C%°(G) be the space of smooth compactly supported functions on G. 
The following two theorems will be used in lemma 13.11 

Theorem 2.3. ([C\, Dixmier-Maliavin) Let G be a Lie group and (tt, V) a contin- 
uous representation of G on a Frechet space. Then every v G V°° may be represented 
as a finite linear combination 

where f k G C™(G) and v k G V°° , for all k. 

Theorem 2.4. ([T, Thm 51.6,(c)]j Let K C W rn and L C R n be compact sets. Then 

C™(K)®C™(L) = C™{K x L). 

Corollary 2.5. Let G = GL n (C) C M 2 ™ 2 . T/ien 

C C °°(G x G) C C C 00 (G)®C' C 00 (G). 

Proof. Let / G C^°(G x G). Then supp(f) is a compact set in G x G, namely, there 
exist compact sets X C R 2n and L C R 2n , such that supp(f) C. K x L. Hence, 

/ G C?{K x L) = C?{K)®C™{L). 

But C™{K)®C™{L) C G C 00 (G)®C' 6 00 (G) and we obtain that / G G C 00 (G)®C' 6 00 (G). □ 

Let M be a smooth manifold. Denote by S{M) the Frechet space of Schwartz 
functions on M. Denote by 

S*(M) := {S(M)Y 
the space of Schwartz distributions on M. 

In the second part of the proof Theorem ll.il we use the following theorem of Aizenbud 
and Gourevitch, see further [AG I Propositions 3.1.3, 3.1.4 and Theorem A], see also 

m- 

Theorem 2.6. Any GL n (M.) -invariant distribution on M n+1 (R) is invariant under 
the transposition. 

In fact, Theorem [ZB] implies that P(M n+1 (R)) GL "W- x = 0. Proposition 3.1.5 in 
[AGJ together with Theorem 3.1.1 imply that 

S*{M n+1 {R)) GLn{R) ' x = 0. 

It follows that a GL„,(R)-invariant Schwartz distribution on M„ + i(R) is also invariant 
under the transposition. Then the implication 

(^(M^R)) 6 ^'* = 0) (P(M n+1 (R)) G ^' x = 0), 
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which follows from [AG2J Theorem 4.0.2], implies that a GL n (M)-invariant distribu- 
tion on M n+ i(R) is also invariant under the transposition. 

3. Proposition 11.21 implies theorem 11.11 

Lemma 3.1. Let (tt, V) be an irreducible, admissible representation ofG. Let (tt, V) 
be the contragredient of (tt, V) . Then there exists a morphism of G x G-modules with 
a dense image 

A n : G C °°(G) -> VW. 

Corollary 3.2. The dual map 

Al : V*®V* ->• V(G) 
is an injective morphism of G x G-modules. 

Proof. The proof follows [Bj pp. 76-77]. We define the map as a composition 

A w : C C °°(G) -»■ Hom(V,V) ~ V®V*, 

where the isomorphism Hom(V, V) ~ V(8)V* follows from the standard theory of 
nuclear Frechet spaces, see, for example, |AG[ Lemma A. 0.8]. 
The map C^°(G) —> Hom(V, V) is given by 

f ^ (v ^ n(f)v: = / f(g)(n(g)v)dg). 
Jg 

Since / G G£°(G), it follows that the image of A n is contained in (V<S> V*)°°. By 
the Dixmier-Malliavin theorem (Theorem 12 .3[) . the space of smooth vectors in V®V* 
is a subspace of V®V. Indeed, let v G (V®V*)°° . Then by the Dixmier-Malliavin 
theorem, 

k 

v = yv(Fj)^, 

i=l 

where i>< G VW* and F { G C C °°(G x G). Since G C °°(G x G)(VW*) C VW, we have 
that v G V®V\ 

To prove the inclusion C^°(G x G)(V<g>V*) C V®V one can argue as follows. We 
know that for / G C^°(G),v G V and v' G V* one has that n(f)v G V and n(f)v' G V". 
By taking a tensor product of these maps we obtain a map 

C?(G)®V®C?{G)®V* ^ VW. 

We then have a map 

(3.1) (C™(G)®C™(G))®(V®V*) ^V®V. 
By Corollary 12.5} we have the following inclusion: 

(3.2) G C °°(G x G) C G C 00 (G)®G C 00 (G). 

Combining 13.11 and 13. 2^ we obtain a non-zero morphism of G x G-modules 

: G C °°(G) ->■ V®V. 

Since V®V is an irreducible G x G-module - see |AG| p. 289] - we obtain that the 
map A-k has a dense image. 
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□ 

Theorem 3.3. Suppose that 

V(G) HxP = V(G) HxH . 

Then Theorem \l.l\ holds. 

Proof. The proof repeats almost verbatim [0, p. 177]. 

Let (it, V) be an irreducible, admissible if-distinguished representation. Then the 
contragredient representation (it, V) is also an irreducible, admissible if -distinguished 
representation. Indeed, by the theorem of Aizenbud, Gourevitch and Sayag, |AGS[ 
Theorem 2.4.2], see also the theorem of Gelfand-Kazhdan in the p-adic case, [GKj . 
the contragredient representation is if'-distinguished, where 

H' = { l h- l \h e H}. 

Since clearly H' = H, we get that the representation (fr, V) is if-distinguished. 
Take two non-zero linear forms A G (V - *) and /i G (V*) p . Then, by Corollary 13. 2\ 

7^ A* (/j, (g) A) G V(G) PxH . 

By the assumption, <g> A) G V(G) HxH . Since A* is an injective morphism of 

G x G-modules, it follows that fi ® A G (\/*®1/*) //><H . Therefore G □ 

We see that in order to prove Theorem 11.11 it is enough to prove that 

V{G) HxP = V{G) HxH . 

We want to show that 

(3.3) V(G) HxP ~ V(H\G) P ~ V(X) P , 

(3.4) V(G) HxH ~V(H\G) H ~V(X) H . 
These isomorphisms follow from the next lemma. 

Lemma 3.4. Let Q be a Lie group and let R be a closed Lie subgroup of Q. Then 
for any subgroup Q' < Q we have 

(3.5) V(R\Q) Q ' ~ V(Q) RxQ '. 

Proof. We prove this by applying the Frobenius descent twice. Let 

Y = R\Q x Q. 

The group Q x Q' acts on Y by 

pi(q,q) ■ (x,x') := (xq^ 1 , qx'q'~ l ). 
Take Z = R\Q with Q x Q' acting on Z by 

P2{q,q') ■ x := xq' 1 . 
This action is transitive and we have a commutative diagram 



(3.6) 



Y Y 



Z -» + 
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where <p(x, q') = x is the projection onto the first coordinate. 
Let x = Rcq G Z be the identity coset. The fiber above ReQ is 

<jr\x) = {x}xQ~Q 

and the stabilizer is (Q x Q') x = R x Q' . We thus obtain 

(3.7) V(Y) QxQ ' ~ V(Q) RxQ ' . 

The group Q x Q' acts on the group W = Q by 

p 3 {q,q') ■ x := gxg'" 1 . 

This action is transitive and we have a commutative diagram 



(3. 



Y Y 



W — VP 



where ip(x, q') = q' is the projection onto the second coordinate. 

The stabilizer of x = e Q G W is (Q x (5% = {(g, q') G Q x = — Q'> an d the 

fiber above x is 

ifj-\x) = R\Q xx- R\Q. 

We have that 

(3.9) V (y) QxQ ' ~ V(R\Q) Q '. 

Combining (13.71) and (13. 9p . the result follows. □ 

Note that H is indeed a closed subgroup of G. Thus, isomorphims in (13. 3p follow 
from Lemma E31 with Q = G,R = H,Q' = P and isomorphims (13.41) follow from this 
lemma with Q = G,R = H,Q' = H. To summarise, the main theorem follows by 
implying (13.31) and (13 .4p to Proposition 11.21 

4. Proof of the main proposition 11.31 

Before we begin the proof we shall introduce some notation. 
Let 

x G M n (C) : x + x = j = i ■ M n (R 

Thus, x i — y ix is an isomorphism M n (R) ~ X of //-spaces, where H acts on both 
M n (R) and X by conjugation. 
Let 9 : X ->■ R, 



0(x) = det(I n + x)det(I n — x) = det(I n + x)det(I n + x). 

Clearly, 9 is a continuous //-invariant map. The proof of Proposition 11.31 is given in 
two steps. We begin with the following linearization argument (the idea appeared in 
jXGSl p. 1511]). 

Lemma 4.1. Let 

X = 9~ 1 (W) = jx G X|0(x) ^ oj. 

Then GL n _i(R) acfo OTJ Xo, and any £ G I?(Xo)^ n invariant under the trans- 

position. 
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Proof. The proof is an adaptation of Proposition 3.2.3 from [AGS] to our case. The 
idea is to take a distribution on Xo and "extend" it to a distribution on X. By 
Theorem 12.61 we have that any £ G T > (X) GLn ~ 1 ^ is invariant under the transposition. 

Hence, we have V(X) GLn - l( ^> x = 0. We need to prove that X?(X ) Gi "- l(B;) ' x = 0. 

Assume the contrary, and let ^ £ G V(Xo) GLn ~ 1 ^' x . Take p G Supp(£) and let 
t = 0(p). Note that t ^ 0. Let / G be such that / vanishes in a neighborhood 

of zero and such that f{t) ^ 0. Consider £' := (/ o 0) ■ £, i.e., 

i'{h) = z{h-{foe)) 

for all /i G ^(Xo). Then f G £>(X ) GL "- l(R) ' x . However, we can extend f "by zero" 

to 

f" G r>(X) Gi "- l(R) ' x = 0. 
Therefore £' = 0, and we obtained a contradiction! □ 

Next, define a covering of X by open if-subspaces as follows. Note that if A G C* 
is an eigenvalue of x G X then A A = 1. For every such A let 

X\ = jiG X\det(x - XI n ) ^ 

Note that X — X\ consists of all the matrices in X with A as an eigenvalue. Since 
every matrix x G X has at most n different eigenvalues we obtain a finite covering of 
X by open i^-subspaces 

n+l 

x=\Jx Xi , 

1=1 

where Ai, A n+ i are any n+l distinct chosen numbers such that XjXj = 1. 

Next, we have an isomorphism of ff-spaces Xo and X\. The isomorphism is given by 

a Cayley transform 

ix{x) = (x + XI n )(x- XI n )-\ 

The proof that this is indeed an isomorphism is given in [O], pp. 181-182. Our 
purpose is to prove that every distribution £ G T>(X) which is GL n _i(lR)-invariant is 
invariant under the transposition. This is equivalent to 

(4.1) p( X )GWR), x = Q _ 

The last equation now follows from the next simple lemma, which is a special case of 
[AGl Proposition 2.2.6]. 

Lemma 4.2. Assume that a Lie group G acts on a smooth manifold X . Let 

k 

X = {jA t 

i=l 

be a finite open covering, where Ai are G-invariant open subsets. Suppose T>[Ai) G ' x = 
for all i = 1, k. Then 

V(X) G ' X = 0. 

This completes the proof of Proposition 11.21 and therefore the proof of Theorem 

o 
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